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Abstract 



When constructing finite frames for a given application, the most important consideration is the spectrum of the frame 
operator. Indeed, the minimum and maximum eigenvalues of the frame operator are the optimal frame bounds, and 
the frame is tight precisely when this spectrum is constant. Often, the second-most important design consideration 
is the lengths of frame vectors: Gabor, wavelet, equiangular and Grassmannian frames are all special cases of equal 
norm frames, and unit norm tight frame-based encoding is known to be optimally robust against additive noise and 
erasures. We consider the problem of constructing frames whose frame operator has a given spectrum and whose 
vectors have prescribed lengths. For a given spectrum and set of lengths, the existence of such frames is characterized 
by the Schur-Hom Theorem — ^they exist if and only if the spectrum majorizes the squared lengths — the classical proof 
of which is nonconstructive. Certain construction methods, such as harmonic frames and spectral tetris, are known 
in the special case of unit norm tight frames, but even these provide but a few examples from the manifold of all 
such frames, the dimension of which is known and nontrivial. In this paper, we provide a new method for explicitly 
constructing any and all frames whose frame operator has a prescribed spectrum and whose vectors have prescribed 
lengths. The method itself has two parts. In the first part, one chooses eigensteps — a sequence of interlacing spectra — 
that transform the trivial spectrum into the desired one. The second part is to expUcitly compute the frame vectors in 
terms of these eigensteps; though nontrivial, this process is nevertheless straightforward enough to be implemented 
by hand, involving only arithmetic, square roots and matrix multiplication. 
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1. Introduction 

Letting K be either the real or complex field, the synthesis operator of a sequence of vectors F = {/n)^=i in 
M-dimensional Hilbert space Mm over K is F : K'^ ^ Hm, Fg Zn=i g(n)fn. Viewing Hm as K^, F is the M x A? 
matrix whose columns are the /„'s. Note that here and throughout, we make no notational distinction between the 
vectors themselves and the synthesis operator they induce. The vectors F are said to be a frame for if there exists 
frame bounds < A < B < oo such that A||/||2 < \\Fyf < B\\ff for aU / e H^. In this finite-dimensional setting, 
the optimal frame bounds A and B of an arbitrary F are the least and greatest eigenvalues of the frame operator. 



respectively. Here, f* is the linear functional /„* : Ha? — > K, f*f := (/, /„). In particular, we have that F is a frame if 
and only if the /„'s span Hm, which necessitates M <N. 



Email address: Matthew . FickusSaf it . edu (Matthew Fickus) 



N 




(1) 



Preprint submitted to Elsevier 



January 27, 2013 



Frames provide numerically stable methods for finding overcomplete decompositions of vectors, and as such are 
useful tools in various signal processing applications [18, 19]. Indeed, if F is a frame, then any / e Mm can be 
decomposed as 

N 

f^FF*f^Yj^fJ„)f„, (2) 

n=l 

where F - {fn]^^i is a dual frame of F, meaning it satisfies FF* - I. The most often-used dual frame is the canonical 
dual, namely the pseudoinverse F - {FF*y^F. Note that computing a canonical dual involves the inversion of the 
frame operator. As such, when designing a frame for a given application, it is important to retain control over the 
spectrum {/lm),^=i of FF*. Here and throughout, such spectra are arranged in nonincreasing order, with the optimal 
frame bounds A and B being Am and A\, respectively. 

Of particular interest are tight frames, namely frames for which A - B. Note this occurs precisely when A,,, - A 
for all m, meaning FF* - Al. In this case, the canonical dual is given \>y fn- jfn, and (2) becomes an overcomplete 
generalization of an orthonormal basis decomposition. Tight frames are not hard to construct: we simply need the 
rows of F to be orthogonal and have constant squared norm A. However, this problem becomes significantly more 
difficult if we further require the /„'s — the columns of F — to have prescribed lengths. 

In particular, much attention has been paid to the problem of constructing unit norm tight frames (UNTFs): tight 
frames for which ||/„|| = 1 for all n. Here, since MA - Ti(FF*) = Ti{F*F) = A^, we see that A is necessarily ^. 
UNTFs are known to be optimally robust with respect to additive noise [14] and erasures [7, 15]. Moreover, all unit 
norm sequences F satisfy the zeroth-order Welch bound Ti[(FF*)^] > which is achieved precisely when F is a 
UNTF [25, 26]; a physics -inspired interpretation of this fact leading to an optimization-based proof of existence of 
UNTFs is given in [2]. We further know that such frames are commonplace: when N > M + I, the manifold of 
all M X real UNTFs, modulo rotations, is known to have dimension (M - 1){N - M - 1) [12]. Essentially, when 
= M -I- 1, this manifold is zero-dimensional since the only UNTFs are regular simplices [13]; each additional unit 
norm vector injects M - I additional degrees of freedom into this manifold, in accordance with the dimension of the 
unit sphere in M*^. Local parametrizations of this manifold are given in [22]. The Paulsen problem involves projecting 
a given frame onto this manifold, and differential calculus-based methods for doing so are given in [3, 5]. 

In light of these facts, it is surprising to note how few explicit constructions of UNTFs are known. Indeed, a 
constructive characterization of all UNTFs is only known for M = 2 [13]. For arbitrary M and A^, there are only 
two known general construction techniques: truncations of discrete Fourier transform matrices known as harmonic 
frames [13] and a sparse construction method dubbed spectral tetris [6]. To emphasize this point, we note that there 
are only a small finite number of known constructions of 3 x 5 UNTFs, despite the fact that an infinite number of 
such frames exist even modulo rotations, their manifold being of dimension (M - 1)(A^ - M - I) - 2. The reason for 
this is that in order to construct a UNTF, one must solve a large system of quadratic equations in many variables: the 
columns of F must have unit norm, and the rows of F must be orthogonal with constant norm (^)^ ■ 

In this paper, we show how to explicitly construct all UNTFs, and moreover, how to explicitly construct every 
frame whose frame operator has a given arbitrary spectrum and whose vectors are of given arbitrary lengths. To do so, 
we build on the existing theory of majorization and the Schur-Hom Theorem. To be precise, given two nonnegative 
nonincreasing sequences {A„}^^^ and {yu„)^^p we say that {/l„)^^i majorizes {//„)^^j, denoted {/i„)^^j > {/i„)^^p if 

n n 

2^'>2'"«' V« = 1,...,A?- 1, 

«' = ! «'=! 
N N 

n'-l 

Viewed as discrete functions over the axis {1, . . . , A^), having {/i„)^^j majorize {/inl^^i means that the total area under 
both curves is equal, and that the area under is distributed more to the left than that of {//„)^^j. A classical 

result of Schur [21] states that the spectrum of a self-adjoint positive semidefinite matrix necessarily majorizes its 
diagonal entries. A few decades later, Horn gave a nonconstructive proof of a converse result [16], showing that if 
{^n}^^i i (jU/jII^^p then there exists a self-adjoint matrix that has {A„}'^^-^ as its spectrum and {jUnl^^j as its diagonal. 
These two results are collectively known as the Schur-Horn Theorem: 
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Schur-Horn Theorem. There exists a positive semidefinite self-adjoint matrix with spectrum {/Ijjj^^j and diagonal 

=1- 



entries {yu„)^^j if and only //'{/i,,)^^! > {jU„)^^ 



Over the years, several methods for expHcitly constructing Horn's matrices have been found; see [10] for a nice 
overview. Many current methods rely on Givens rotations [8, 10, 24], while others involve optimization [9]. With 
regards to frame theory, the significance of the Schur-Horn Theorem is that it completely characterizes whether or not 
there exists a frame whose frame operator has a given spectrum and whose vectors have given lengths; this follows 



from applying it to the Gram matrix F*F, whose diagonal entries are the values )^^[ and whose spectrum {/ln)„^i 
is a zero-padded version of the spectrum {A„,}^^^-^ of the frame operator FF*. Indeed, majorization inequalities arose 
during the search for tight frames with given lengths [4, 11], and the explicit connection between frames and the 
Schur-Horn Theorem is noted in [1, 23]. This connection was then exploited to solve various frame theory problems, 
such as frame completion [20]. 

In this paper, we follow the approach of [17] in which majorization is viewed as the end result of the repeated 
application of a more basic idea: eigenvalue interlacing. To be precise, a nonnegative nonincreasing sequence {yml^^i 
interlaces on another such sequence i/?,,,),^^!, denoted {y6m)m=i C {ym),^=p provided 

/3m <7m < j6m-i < Tm-i < ■ ■ ■ < j62 < 72 < ySi < ri ■ (3) 

Under the convention 7m+i 0, we have that {y6,„),']f^[ C {ym)m=i if and only if y„,+i < /3„, < y,„ for all m = 1, . . . ,M. 
Interlacing arises in the context of frame theory by considering partial sums of the frame operator (1). To be precise, 
given any sequence of vectors F - in Mm, then for every n - I, ... ,N, we consider the partial sequence of 

vectors F„ := {f„>}"f^i - Note that - F and the frame operator of F„ is 



F„F:^j]f„,f:,. (4) 



Let {/l„;m}^^i denote the spectrum of (4). For any n = 1, . . . , A' - 1, (4) gives that F^^^F^^^ — F^^F* ff,^if^^i tind so a 
classical result [17] involving the addition of rank-one positive operators gives that {A„-„}ff^^^ C {/ln+i;;K)m=i ■ Moreover, 
if ll/ilP = //„ for all n = 1, . . . , A^, then for any such n, 



M 



Note that as n increases, the Gram matrix grows in dimension but the frame operator does not since f *f „ 
but F^F* : Mm — » Mm. We call a sequence of interlacing spectra that satisfy (5) a sequence of eigensteps: 



Definition 1. Given nonnegative nonincreasing sequences {/lm),'|f=i and {yU„)^^j, a sequence of eigensteps is a doubly- 

'■<"'m=l'n=0 



indexed sequence of sequences {{A„-ii,}^, )^ „ for which: 



(i) The initial sequence is trivial: 

(ii) The final sequence is {/iml^^j: 

(iii) The sequences interlace: 

(iv) The trace condition is satisfied: 



Ao-,,,^0 Vm=l,...,M. 
Ai^m — Am Vm = 1, . . . , M. 



^/l«;m = ^A'n' Wn^l,...,N. 
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As we have just discussed, every sequence of vectors whose frame operator has the spectrum {/Iml^^j and whose 
vectors have squared lengths {yUnj^^j generates a sequence of eigensteps. In the next section, we adapt a proof tech- 
nique of [17] to show the converse is true. Specifically, Theorem 2 characterizes and proves the existence of sequences 
of vectors that generate a given sequence of eigensteps. In Section 3, we then use this characterization to provide an 
algorithm for explicitly constructing all such sequences of vectors; see Theorem 7. Though nontrivial, this algorithm 
is nevertheless straightforward enough to be implemented by hand in small-dimensional examples, involving only 
arithmetic, square roots and matrix multiplication. We will see that once the eigensteps have been chosen, the algo- 
rithm gives little freedom in picking the frame vectors themselves. That is, modulo rotations, the eigensteps are the 
free parameters when designing a frame whose frame operator has a given spectrum and whose vectors have given 
lengths. 

The significance of these methods is that they explicitly construct every possible finite frame of a given spectrum 
and set of lengths. Computing the Gram matrices of such frames produces every possible matrix that satisfies the 
Schur-Horn Theorem; previous methods have only constructed a subset of such matrices. Moreover, in the special 
case where the spectrums and lengths are constant, these methods construct every equal norm tight frame. This helps 
narrow the search for frames we want for applications: tight Gabor, wavelet, equiangular and Grassmannian frames. 

2. The necessity and sufficiency of eigensteps 

The purpose of this section is to prove the following result: 

Theorem 2. For any nonnegative nonincreasing sequences {A^]^^^ and every sequence of vectors F — 

in M.M whose frame operator FF* has spectrum {/iml^^j and which satisfies \\f„\^ — jJ^nfor all n can be constructed 

by the following process: 

A. Pick eigensteps {{/l„;m),')f^i )^_0 os in Definition 1. 

B. For each n - I,. . .,N, consider the polynomial: 

M 

P«W := ]~~[(jC-^;m)- (6) 

m=\ 

Take any fi e Wm such that — For each n — I, . . . ,N — 1, choose any /„+i such that 

= - lim(^ - (7) 

x->^ p„(x) 

for all A e {/l«;m)^^i, where Pn;A denotes the orthogonal projection operator onto the eigenspace N(/iI — F^^F*) 
of the frame operator F^F* ofF„ — {/„')J',^[. The limit in (7) exists and is nonpositive. 

Conversely, any F constructed by this process has {/Iml^^i '^^ spectrum of FF* and ||/„|P = l^nfor all n. 
Moreover, for any F constructed in this manner, the spectrum ofF^F* is {/ln;m)^=i for all n — 1, . . . ,N. 

We note that as it stands. Theorem 2 is not an easily-implementable algorithm, as Step A requires one to select 
a valid sequence of eigensteps — not an obvious feat — while Step B requires one to compute orthonormal eigenbases 
for each F„. These concerns will be addressed in the following section. We further note that Theorem 2 only claims 
to construct all possible such F, sidestepping the issue of whether such an F actually exists for a given {/Iml^^i ^'^'^ 
{yu„)^^j. This issue is completely resolved by the Schur-Horn Theorem. Indeed, in the case where M < N, [I] shows 
that there exists a sequence of vectors F = {/nl^^i in Mm whose frame operator FF* has spectrum {/Iml^^i ^^'^ which 
satisfies = p„ for all n if and only if {A„j}^^-^ U {0)^^^^j > {yL(„)^^j. In the case where M > N, a similar argument 
shows that such a sequence of vectors exists if and only if {/Iml^^i - f/"«)^^=i ^^'^ '^m = for all m = + 1, . . . , M. As 
Step B of Theorem 2 can always be completed for any valid sequence of eigensteps, these majorization conditions in 
fact characterize those values {/iml^^j and {/U„)^^j for which Step A can successfully be performed; we leave a deeper 
exploration of this fact for future work. In order to prove Theorem 2, we first obtain some supporting results. The 
following lemma gives a first taste of the connection between eigensteps and our frame construction problem: 
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Lemma 3. Let {/lm),„^i and {^in}„^^ be nonnegative and nonincreasing, and let {{/lH;m)^^i)„=o '^"^ corresponding 
sequence of eigensteps as in Definition 1. If a sequence of vectors F — has the property that the spectrum of 

the frame operator F^F*^ of F„ — is {/i«;m),'^^j for all n — I, . . . ,N, then the spectrum of FF* is {A„}^^^ and 

\\f£ ^Unforalln^ \,...,N. 

Proof. Definition l(ii) immediately gives that the spectrum of FF* - F^F*^ is indeed - {'^N;m]^=i^ as claimed. 

Moreover, for any n - I, . . . ,N, Definition 1 (iv) gives 



2 II/"' II' = MKF„) = MF„F:) = £ An;,n = J] l^n' 



(8) 



Letting n = 1 in (8) gives ||/i|p - H\, while for n - 2, 



n-l 



m=l «' = 1 

, A^, considering (8) at both n and n-l gives 

n n-l 



Wfnf = Yj II/«'I|' - Z II/'' II' = Z " " 



□ 



n'=l 



n'=l 



«' = 1 



n' = l 



The next result gives conditions that a vector must satisfy in order for it to perturb the spectrum of a given frame 
operator in a desired way, and was inspired by the proof of Theorem 4.3.10 in [17]. 

Theorem 4. Let F„ — {/n')",^[ be an arbitrary sequence of vectors in Mm and let denote the eigenvalues of 

the corresponding frame operator F^F*. For any choice of f„+i inM.M, letF„+i — Then for any A G {/l«;m}^=i' 

the norm of the projection of f„+i onto the eigenspace N{Al — F^F*) is given by 



\\Pn;Af 



n+ll 



= - lim(jic - A) 



Pn+l(x) 



p„(x) 

where p„(x) and /7„+i(x) denote the characteristic polynomials of F^^F* and F^^^F*^^, respectively. 

Proof. For the sake of notational simplicity, let F„ - F, f„+i - f, F„+i = G, P„j = P^, p„(x) - p(x), p„+i(x) = q(x), 
and let /!„;„, - yS„, for all m = I,. . . ,M. We will also use I to denote the identity matrix, and its dimension will be 
apparent from context. To obtain the result, we will express the characteristic polynomial q{x) of the (n+l)x(n + l) 
Gram matrix G*G in terms of the characteristic polynomial p{x) of the n xn Gram matrix F*F. Written in terms of 
their standard matrix representations, we have G = /j, and so 



G*G 



[F f] 



p* p p* y 
f'F ||/||2 



(9) 



To compute the determinant of x\ - G*G, it is helpful to compute the singular value decomposition F - U1.V*, and 
note that for any x not in the diagonal of the following matrix W has unimodular determinant: 



V 
1 



I (xi-s*Er'y*F*/ 

1 



V vixi-i:*^)-^v*F*f 

1 



(10) 



Subtracting (9) from xl and conjugating by (10) yields 
W*(xl - G*G)W 



y* 
(y(xi-z*E)-iy*F*/)* 1 

y* 
/*Fy(xi-r2)-iy* 1 



y y(jci-E*2;)-iy*F*/ 

1 



xl - F*F -F*f 

-fF x-\\ff 

(xl - F*F)V (xl - F*F)V(xl - S*S)-'y*F*/ - F* f 
-f-FV X - ||/||2 - fFVixl - ^*Yr'V*Fy 



Since F*F = VI.*I.V* then xl - F*F ^xl- VY'Y.V = V{xl - 2*2) y*. As such, 

(xl - F*F)v{xi - i:i.)-^v*F*f - F*f = y(xi - s*s)y*y(xi - ri)"'y*F7 - F*f = F*f - F*f = o. 



(11) 



(12) 
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Substituting (12) into (11) and again noting V*ixl - F*F)V = xl- S*S gives 
W(xl - G*G)W 



(xl - F*F)V 

-fFV x-\ 



V* 
fFVixl-rTj-^V* 1 

V*(xl - F*F)V 
fFV(xl - I.*'L)-^V*(xl - F*F)V - f*FV x ■ 

xl - S*S 





2 - fFVixl - 1^*1.)-^ V*F*f 


Iff - fFVixl - 2*2)-iy*F*/ 







- fFVixl -I.*I.)-W*F*f 



Since W has unimodular determinant, (13) implies 

qix) := det(jcl - G*G) = det[H'*(jcI - G*G)W] = det(jcl - S*S)(x - \\ff - fFVixl - r2)-'y*f */). 
To simplify (14), note that since V is unitary, 

pix) det(;cl - F*F) = det[y*(jt;I - F*F)V] = det(;cl - S*Z). 
Moreover, letting (S*S)(n', n') denote the n'th diagonal entry of E*E yields 



fFVixl - T"L)-^v*Fy = iv*Fyyixi - rs)"'(y*F*/) = V 1*^^ ^ f^^" ^1 

■'—j X - (S*E)(«',n' 

Substituting (15) and (16) into (14) gives 

m-mU-vif-t ""ZS"'"'! 



(13) 

(14) 
(15) 

(16) 
(17) 



«'=i 



To continue simplifying (17), let denote the n'th standard basis element. Then V*F* - implies that for any 
n' — I, . . . ,n. 



o-,Af,u„,), n'<M, 
0, n' > M, 



(18) 



iV*F*fin') = {V*F*f,5„) = {ru\f,5n') = </, f/I5„') 
where {cr,,- )™"{*''"' are the singular values of F. Since (S*E)(«', n') = cr^, for any n' - 1, . . . , min{M, n), (18) implies 

|(y*F*/)(n')P min|M,«) ^2|/^„A|2 min(M,« 



^x-il.*'L)in',n') ^ x-(2*2;)(«',«') ^ 



Making the change of variables m = in (19) and substituting the result into (17) gives 



min{M,«( 



~qix)^pix)(x-\\ff- Yj ^^T^K/'""')!") 



(19) 



(20) 



m=\ 



Here, the restriction that x + cr\, . . . , cr^inj^vf „)' follows from the previously stated assumption that x is not equal to 
any diagonal entry of the set of these entries is {o"^,)",^; if M > n and is {cr^,)^^; U {0)",^^ if M < n. Now recall 
that pix) and qix) are the Mth degree characteristic polynomials of FF* and GG*, respectively, while pix) is the nth 
degree characteristic polynomial of F*F and qix) is the in + l)st degree characteristic polynomial of G*G. We now 
consider these facts along with (20) in two distinct cases: n < M and M < n. In the case where n < M, we have that 
pix) - x'^^"pix) and qix) - x'^^^'^^^qix). Moreover, in this case the eigenvalues [fim]'^^^ of FF* - UY.Y.*U* are given 
by j6,„ = (T^j for all m = 1, . . . , n and = for ?A\m-n + 1, . . . , M, implying (20) becomes 

« -"'Kx-llflP-E^K/...,)!') 



rM- 



pix) 



M 



(21) 



In the remaining case where M < n,we have p(x) - x" p(x), q(x) - x"^' ^q{x) and y6,„ - cr^ for all m = 1, . . . ,M, 
implying (20) becomes 



x«+'-^^W = x«->W x-||/||2-y -^K/,M„>|2 Vx^^i,...,/3m,0. (22) 



in=l 

We now note that (21) and (22) are equivalent. That is, regardless of the relationship between M and n, we have 



M 



Writing = ^ K/, m„,)|^ and then grouping the eigenvalues A = {/Sml^^i according to multiplicity gives 



As such, for any A e A, 

lim(x - ^)^ = lim(x - ^)(l - y = lim[(x - A) - \\P,f\\^ - V 



yielding our claim. □ 

Though technical, the proofs of the next two lemmas are nonetheless elementary, depending only on basic algebra 
and calculus. As such, these proofs are given in the appendix. 

Lemma 5. If{lim]m=\ '^"'^ ^y"'^m=\ ^^^^ ^^'^ noninc re using, then \fim\^^\ C {jm\^^\ if and only if 

lim(x-j6„)— < Vm=l,...,M, 

v^A, p{x) 



M M 



where p(x) - ]~~[(-« - A") '^"'^ li^) - ~ T™)- 



m=l m=l 



Lemma 6. If{Pm]„^^i, [jm]„^\, and {6m}^^^^ are real and nonincreasing and 

lim(x-A„)44= Iim(x-Aj4^ Vm=l,...,M, 
j.-^/3„ /?(x) -c^/3„ ;?(x) 

MM M 

where p(x) — ]~~[(-'c — Pm), qix) — |~~[(-^ — Tm) >'(x) — ]~~[(-^ ~ "^m), then q(x) — r(x). 

m= 1 m= 1 m= 1 

With Theorem 4 and Lemmas 3, 5 and 6 in hand, we are ready to prove the main result of this section. 

Proof of Theorem 2. (=>) Let ^^'^ {A'«)^=i ^e arbitrary nonnegative nonincreasing sequences, and let F - 

{fn]^^i be any sequence of vectors such that the spectrum of FF* is {A,„]^^^ and = jt/„ for all n = 1, . . . , A^. We 
claim that this particular F can be constructed by following Steps A and B. 

In particular, consider the sequence of sequences {{A„-„,}^^^^}^^^^ defined by letting {A„-,„}^^-^ be the spectrum of 
the frame operator F^F* of the sequence F„ - {/„')",^[ for all n = 1, . . . and letting Aq-^ = for all m. We claim 
that {{/l„;m)^=i)^^o satisfies Definition 1 and therefore is a valid sequence of eigensteps. Note conditions (i) and (ii) of 
Definition 1 are immediately satisfied. To see that {{/i„;m)^^i )^^q satisfies (iii), consider the polynomials /?„(x) defined 
by (6) for all n = 1, . . . , A^. In the special case where n - I, the desired property (iii) that {Oj^'l^^j C {Ai-,„}^^-^ follows 



from the fact that the spectrum {/li;,„)^^j of the scaled rank-one projection F.^F* - f^f* is the value ||/i|p = fii 
along with M-1 repetitions of 0, the eigenspaces being the span of /i and its orthogonal complement, respectively. 
Meanwhile if n = 2, . . . , A^, Theorem 4 gives that 

Hm (X - ^-l;„,)-^^ = -\\Pn-l;A„^,Jnf < Vm = 1, . . . , M, 

implying by Lemma 5 that {/l„-i;m)^^[ C {^n;m}^^i as claimed. Finally, (iv) holds since for any n - I, ... ,N we have 

M n n 

= Tr(F„F:) = Tr(F:F„) = ^ ||/„,||2 = ^^t/,,. 

m-1 «' = 1 h' = 1 

Having shown that these particular values of {{/!/,;„, Ij'Jf^ilj^^o indeed be chosen in Step A, we next show that our 
particular F can be constructed according to Step B. As the method of Step B is iterative, we use induction to prove 
that it can yield F. Indeed, the only restriction that Step B places on /i is that = yUi, something our particular 
/i satisfies by assumption. Now assume that for any n = l,...,A^-lwe have already correctly produced {fn'T„,^^ by 
following the method of Step B; we show that we can produce the correct /„+i by continuing to follow Step B. To be 
clear, each iteration of Step B does not produce a unique vector, but rather presents a family of /„+i 's to choose from, 
and we show that our particular choice of /„+i lies in this family. Specifically, our choice of f„+\ must satisfy (7) for 
any choice of A e {A.„-,m}^^i', the fact that it indeed does so follows immediately from Theorem 4. To summarize, we 
have shown that by making appropriate choices, we can indeed produce our particular F by following Steps A and B, 
concluding this direction of the proof 

Now assume that a sequence of vectors F = has been produced according to Steps A and B. To 

be precise, letting {{/l„;m)^^i)^^Q be the sequence of eigensteps chosen in Step A, we claim that any F = {/n)^=i 
constructed according to Step B has the property that the spectrum of the frame operator F^F* of F„ - {fn']",^i is 
{/l„.„,)^^j for all « = 1 , . . . , A^. Note that by Lemma 3, proving this claim will yield our stated result that the spectrum 
of FF* is {/l,„)ff=i and that ||/„|p - yu„ for all « - 1,. . . ,N. As the method of Step B is iterative, we prove this claim 
by induction. Step B begins by taking any /i such that ||/i|p = fii. As noted above in the proof of the other direction, 
the spectrum of F^F*^ = /j/j* is the value fii along with M-1 repetitions of 0. As claimed, these values match those 
of {/li;m)^=i; to see this, note that Definition l(i) and (iii) give {0)^^j = {/lo;m)^=i C {Ai-m}^^i and so Ai-,„ - for all 
w = 2, . . . , M, at which point Definition l(iv) implies A^ i - fii. 

Now assume that for any n - I,. . .,N - 1, the Step B process has already produced F„ = {/„')J',^[ such that the 
spectrum of is {An-m}^^i- We show that by following Step B, we produce an such that F„+i - 
has the property that {/l„+i;m)^^[ is the spectrum of F^^-^F*^-^. To do this, consider the polynomials pn{x) and pn+i(x) 
defined by (6) and pick any /„+i that satisfies (7), namely 

hm (X - = -||P„;.i,,,„/«+i II' Vm = 1, . . . , M. (23) 

Pn(x) 

Letting {A„+\-m]f^^i denote the spectrum of F^^^Fl^^, our goal is to show that {^+i;„,)^^i = {A„+i-m]^^i - Equivalently, 
our goal is to show that p„+i{x) = p„+i(x) where p„+i(x) is the polynomial 

M 

Pn+l(x) := - A„+l;m)- 

m=l 

Since pnix) and p„+i(x) are the characteristic polynomials of F^^F* and ^^„+i^^*+p respectively. Theorem 4 gives: 

lim (X - = -||^„;.i,,,„/„+i II' Vm = 1, . . . , M. (24) 

p„(x) 

Comparing (23) and (24) gives: 

hm (x - A„.„,) — = hm (x - A„.„,) — Vm = 1, . . . , M, 

x^A„,„ p„(x) x^A„,„ p„(x) 

implying by Lemma 6 that p„+i(x) = p„+i(x), as desired. □ 
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3. Constructing frame elements from eigensteps 



As discussed in the previous section. Theorem 2 provides a two-step process for constructing any and all sequences 
of vectors F - in Mm whose frame operator possesses a given spectrum {/Iml^^i whose vectors have given 

lengths {yu„)^^j. In Step A, we choose a sequence of eigensteps {{/ln;m)^^[)^^o- '■^^ ^^^^ "'■h sequence {/l„;m)^^j 
will become the spectrum of the nth partial frame operator F^F^, where F„ = {/n')",^;- Due to the complexity 
of Definition 1, it is not obvious how to sequentially pick such eigensteps. Looking at simple examples of this 
problem, such as the one discussed in Example 8 below, it appears as though the proof techniques needed to address 
these questions are completely different from those used throughout this paper. As such, we leave the problem of 
parametrizing the eigensteps themselves for future work. In this section, we thus focus on refining Step B. 

To be precise, the purpose of Step B is to explicitly construct any and all sequences of vectors whose partial-frame- 
operator spectra match the eigensteps chosen in Step A. The problem with Step B of Theorem 2 is that it is not very 
explicit. Indeed for every n - l,...,A^-l,in order to construct /„+ 1 we must first compute an orthonormal eigenbasis 
for F^F*. This problem is readily doable since the eigenvalues {/l„;m)^^j of F„F* are already known. It is nevertheless 
a tedious and inelegant process to do by hand, requiring us to, for example, compute QR-factorizations of /i„;„,I-F„F* 
for each m - I, . . . ,M. This section is devoted to the following result, which is a version of Theorem 2 equipped 
with a more explicit Step B; though technical, this new and improved Step B is still simple enough to be performed 
by hand, a fact which will hopefully permit its future application to both theoretical and numerical problems. 

Theorem 7. For any nonnegative nonincreasing sequences {^m]^^\ cind {//„)^^j, every sequence of vectors F — {/n)^^[ 

J and which satisfies ||/„|P — jJ^nfor all n can be constructed 



in M.M whose frame operator FF* has spectrum {/i 
by the following algorithm: 



Specifically: 
If for all m' < m and such that the 



A. Pick eigensteps {{/ln;m)^^i)™^o Definition 1. 

B. Let U\ be any unitary matrix, U\ — and let f\ — yfjJiUi-i. For each n — I, . . . ,N - I: 

B.l Let V„ be an M X M block-diagonal unitary matrix whose blocks correspond to the distinct values of 

{/l„;,„)^^j with the size of each block being the multiplicity of the corresponding eigenvalue. 
B.2 Identify those terms which are common to both {A.n-m}^^i ond {/l„+i;m) 

• Let I„ c {!,..., M] consist of those indices m such that A„-^„ < An 
multiplicity of A„-,„ as a value in {/ln;m')m/=i exceeds its multiplicity as a value in {/l«+i;m'j,„'=i- 

• Let J'n C {I, M} consist of those indices m such that A„+i-„j < A„+i-,„i for all tn' < m and such that 
the multiplicity of A„-„, as a value in {/i«+i;m')^=i exceeds its multiplicity as a value in {A„-„,'}^^,^y 

The sets I„ and J'„ have equal cardinality, which we denote R„. Next: 

• Let TTj^ be the unique permutation on {1, . . . , M] that is increasing on both I„ and and such that 

e { 1, . . . , R„}for all m e I„. Let IIj,, be the associated permutation matrix Uj^ 

• Let TTj^^ be the unique permutation on {I, ... , M} that is increasing on both J'n and J'^ and such that 
jij^{m) e {1, . . . ,R„}for all m e J'„. Let IIj-^ be the associated permutation matrix lij^dm — 5nj„{m)- 

B.3 Let v„, w„ be the R„ X I vectors whose entries are 



v„(ni^(m)) = 



I I {An-ij, /ln+l,m") 



m"^m 



I I (■^«+ 1 ;m' ^n.m" ) 
m"£l,, 



]~~[ (^n+l;m' ~ ^n+l;m") 



m" #m' 



B.4 /„+i = f/„y„nT 

B.5 f/„+i 





W„ 
I 



where the M x \ vector 



is v„ padded with M — R„ zeros. 
Ilj^ where W„ is the R„ X R„ matrix whose entries are: 
1 



A„ 



n' Af, 



- Vn (7Ti„ (m))w„ (tt j^,, (m' )) . 
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Conversely, any F constructed by this process has {A,„}^^^^ as the spectrum ofFF* and ||/„|P = l-infar all n. 
Moreover, for any F constructed in this manner and any n — I,. ..,N, the spectrum of the frame operator F^F* 
arising from the partial sequence F„ — {fn'T„,^\ is {/ln;m)m=i, cmd the columns of Un form a corresponding orthonormal 
eigenbasis for F^^F*. 

Before proving Theorem 7, we give an example of its implementation, with the hope of conveying the simplicity 
of the underlying idea, and better explaining the heavy notation used in the statement of the result. 

Example 8. We now use Theorem 7 to construct UNTFs consisting of 5 vectors in M?. Here, /ti = /I2 = /I3 = f and 
yUi = = A's = ^(4 = yus = 1. By Step A, our first task is to pick a sequence of eigensteps consistent with Definition 1, 
that is, pick /ii;2, /li;3), {/l2;i, 'l2;2, 't2;3), {^3;\, ^3;2, ^^i-^] and {/i4;i , /l4;2, /t4;3 ) that Satisfy the interlacing conditions: 

{0,0,0) C {Ai,uAu2,M;3] C {^2;l,^2;2,/l2;3) C {/l3;l , ^3;2, ^3;3 ) C {A4;U U,2, U,3] C {f , f ; f ), (25) 

as well as the trace conditions: 

'il;! + 'il;2 + 'il^ = 1> ^^2;! + ^^2:2 + '^23 = 2, Aj-^i + A2;2 + ^3;3 = ^7 '^4;! + ^^4:2 + ^^43 = 4. (26) 

Writing these desired spectra in a table: 

« 1 2 3 4 5 



^„;3 ? ? ? ? 

9 9 9 9 



9 9 9 9 



the trace condition (26) means that the sum of the values in the nth column is 2"'=i/^n' = while the interlacing 
condition (25) means that any value A„-i„ is at least the neighbor to the upper right /i„+i;,„+i and no more than its 
neighbor to the right /l„+i;m. In particular, for n = 1, we necessarily have - Ao-2 5 ^i;2 5 '^O;! - and - Aq-^ < 
/ii;3 < /lo;2 - implying that Ai-2 = /fi;3 = 0. Similarly, for n = 4, interlacing requires that | - /l5;2 < A4-i < A^-j = | 
and I - A^-i < A^-^i < /l5;2 - | implying that A4-i = /l4;2 = |. That is, we necessarily have: 



n 





1 


2 


3 


4 


5 


'1h;3 








? 


? 


? 


5 
3 










? 


? 


5 
3 


5 
3 


'In;! 





? 


? 


? 


5 

3 


5 

3 


Applying this same idea again for n 


- 2 and 


In = 3 g 


;ives = /li; 


;3 ^ ^^2:3 


< ^l;2 = 


and f 


and so we also necessarily have that A2-3 - 0, and /I3; 


5. 

1 - 3- 








n 





1 


2 


3 


4 


5 


^n;3 











? 


? 


5 
3 










? 


? 


5 
3 


5 
3 


-In;! 





? 


? 


5 

3 


5 

3 


5 

3 


Moreover, the trace condition (26) at 


n - I ^ 


^ives 1 = 


- -^1;! + ^1;2 


+ ^U3 = 


Ai-i +0 + and : 


trace condition at « = 4 gives 4 = /I4; 


1 + ^4-2 


+ ^4;3 = 


1 + 1 + A4-: 


3 and so A4-3 = | : 




n 





1 


2 


3 


4 


5 


^n;3 











? 


2 
3 


5 
3 










? 


? 


5 
3 


5 
3 







1 


? 


5 
3 


5 
3 


5 
3 



1. Similarly, the 
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Figure 1: Pairs of parameters (x,y) tliat generate a valid sequence of eigensteps wlien substituted into (27). To be precise, in order to satisfy the 
interlacing requirements of Definition 1, x and y must be chosen so as to satisfy the 1 1 pairwise inequalities summarized in (28). Each of these 
inequalities corresponds to a half-plane (a), and the set of (x,y) that satisfy all of them is given by their intersection (b). By Theorem 7, any 
corresponding sequence of eigensteps (27) generates a 3 X 5 UNTF and conversely, every 3x5 UNTF is generated in this way. As such, x and 
y may be viewed as the two essential parameters in the set of all such frames. In particular, for (,r, y) that do not lie on the boundary of the set in 
(b), applying the algorithm of Theorem 7 to (27) and choosing U i = Vi = V2 = V3 = V4 = I yields the 3x5 UNTF whose elements are given in 
Table 1. 



The remaining entries are not fixed. In particular, we let At,-^^ be some variable x and note that by the trace condition, 
3 - At,-i + At,-2 + ^3;3 - x + Ax2 + f and so A3-2 = I - X. Similarly letting A2-2 - y gives /l2;i = 2 - y: 

n 1 2 3 4 5 

A„;3 

An;2 

1 

We take care to note that x and y in (27) are not arbitrary, but instead must be chosen so that the interlacing rela- 
tions (27) are satisfied. In particular, we have: 

x<|<|-x<|, 

0<x<y<|-x<2-3;<|, (28) 
0<3'<l<2-3;. 

By plotting each of the 1 1 inequalities of (28) as a half -plane (Figure 1(a)), we obtain a 5-sided convex set (Figure 1(b)) 
of all (x,y) such that (27) is a valid sequence of eigensteps. Specifically, this set is the convex hull of (0, |), (5, |), 
(5^ f ). (5; 1) and (0, |). We note that though this analysis is straightforward in this case, it does not easily generalize 
to other cases in which M and are large. 

To complete Step A of Theorem 7, we pick any particular (x, y) from the set depicted in Figure 1(b). For example. 



y 

2- 



(27) 



{/l3;l,^3;2,'^3;3) C {A4-i , A4-2, ^4;3] 
{/l2;l,^2;2,'l2;3) C {Aj-i , A3-2, ^3;3] 
{/ll;l,^l:2,'ll;3) C {A2-1 , A2-2, A2-3] 
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if we pick ix,y) = (0, then (27) becomes: 



n 





1 


2 


3 


4 


5 
















2 
3 


5 
3 










1 

3 


4 

3 


5 
3 


5 
3 







1 


5 
3 


5 
3 


5 

3 


5 

3 



(29) 



We now perform Step B of Theorem 7 for this particular choice of eigensteps. First, we must choose a unitary matrix 
Ui. Considering the equation for U„+i along with the fact that the columns of Un will form an eigenbasis for F, 
we see that our choice for Ui merely rotates this eigenbasis, and hence the entire frame F, to our liking. We choose 
Ui = 1 for the sake of simplicity. Thus, 

[11 

/i = -v^Mi;i = 


We now iterate, performing Steps B. 1 through B.5 for « = 1 to find /2 and U2, then performing Steps B. 1 through B.5 
for n = 2 to find and Uj,, and so on. Throughout this process, the only remaining choices to be made appear in 
Step B.l. In particular, for n = 1 Step B.l asks us to pick a block-diagonal unitary matrix Vi whose blocks are sized 
according to the multiplicities of the eigenvalues {/li;i,/li;2,/ti;3) - {1,0,0). That is, V\ consists of a 1 x 1 unitary 
block — a unimodular scalar — and a 2 x 2 unitary block. There are an infinite number of such Vi's, each leading to 
a distinct frame. For the sake of simplicity, we choose Vi - I. Having completed Step B.l for n = 1, we turn to 
Step B.2, which requires us to consider the columns of (29) that correspond to n = 1 and n -2: 



(30) 



In particular, we compute a set of indices I\ c {1,2,3) that contains the indices m of {/ii;i, /li;2, /fi;3) - {1,0,0) for 
which (i) the multiplicity of /li;,„ as a value of {1,0,0) exceeds its multiplicity as a value of {/l2;i, ^^2:2, '^2:3) - {f , 5,0) 
and (ii) m corresponds to the first occurrence of Ai-„, as a value of {1,0,0); by these criteria, we find Ii - {1,2). 
Similarly m 6 J7i if and only if m indicates the first occurrence of a value A2-^„, whose multiplicity as a value of 
{ 1 , 1 , 0} exceeds its multiplicity as a value of { 1 , 0, 0), and so ^1 = {1,2). Equivalently, Ii and JTi can be obtained by 
canceling common terms from (30), working top to bottom; an explicit algorithm for doing so is given in Table 2. 

Continuing with Step B.2 for « = 1, we now find the unique permutation ttj, : {1,2,3) — > {1,2, 3) that is increasing 
on both I\ - {1,2} and its complement Jj - {3) and takes I\ to the first R\ - \I \\ - 2 elements of {1,2,3). In this 
particular instance, ttj, happens to be the identity permutation, and so IIj, - I. Since J7i = { 1, 2) = Ji, we similarly 
have that nj^ and II are the identity permutation and matrix, respectively. 

For the remaining steps, it is useful to isolate the terms in (30) that correspond to I\ and J'\: 



n 


1 


2 


^«;3 













1 
3 




1 


5 
3 



Pi - ^\;2 =0, 72 = /l2;2 = 5 



ySl = /li;i = 1, 71 = A2-\ = f 



(31) 



In particular, in Step B.3, we find the Ri x \ - 2 x \ vector v'l by computing quotients of products of differences of 
the values in (31): 



- Jim - 72) ^ (0 - i)(0 - 

iPi-Pi) (0-1) 



[Vl(2)] = — — = = |, (33) 
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yielding vi 



Similarly, we compute wi 



according to the formulas: 



r nM2 (ri-y8i)(ri-j62) (f-l)(f-0) ^ 
[wi(l)] = 



(n - 72) 



(- - -) 

1 ^\^^ 



[wi(2)] = 



(72-71) 



(1 _ 5-) 



(34) 
(35) 



Next, in Step B.4, we form our second frame element /2 - U\ VillJ 



/2 = 



1 
1 
1 



1 
1 
1 



1 
1 
1 



r 2 
3 

VI 

3 





As justified in the proof of Theorem 7, the resulting partial sequence of vectors 

1 

^2 = [/l fl]^ 



2 
3 

f 




has a frame operator F^F^ whose spectrum is {/i2;i, /l2;2> ^2;3) - {f > j-O). Moreover, a corresponding orthonormal 
eigenbasis for F^F^ is computed in Step B.5; here the first step is to compute the R\ x R\ -2x2 matrix W\ by 
computing a pointwise product of a certain 2x2 matrix with the outer product of vi with w\: 



1 1 

1 1 

n-A 72-/32 



O 



vi(l) 
vi(2) 





r3 


3- 




"2V5 


2 




r V5 


1 


wi(l) wi(2)l = 


2 
3 
L5 


2 

3 _ 





3V6 
5 


3V6 
Jl 




V6 

1 


V6 
V5 










-3V6 


3V6 




L V6 


V6 J 



Note that Wi is a real orthogonal matrix whose diagonal and subdiagonal entries are strictly positive and whose 
superdiagonal entries are strictly negative; one can easily verify that every W„ has this form. More significantly, the 
proof of Theorem 7 guarantees that the columns of 



U2 = f/iVinJ^ 



Wi 
1 



n 



J, 



1 
1 
1 



1 
1 
1 



1 
1 
1 



VI _J_ Q 

J_ VI 
1 



1 
1 
1 



VI _J_ 

Vf) V6 

J_ VI 

Vf) V6 

1 



form an orthonormal eigenbasis of F^F^- This completes the n - I iteration of Step B; we now repeat this process 
for n -2, 3,4. For n = 2, in Step B.l we arbitrarily pick some 3x3 diagonal unitary matrix V2- Note that if we wish 
our frame to be real, there are only 2^ = 8 such choices of V2. For the sake of simplicity, we choose V2 = I in this 
example. Continuing, Step B.2 involves canceling the common terms in 



to find I1-J2- {2), and so 



n^2 



1 

1 
1 
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In Step B.3, we find that V2 - W2 - [l]. Steps B.4 and B.5 then give that F3 - ^ fi /sj and U-i are 



= 



1 


2 


1 


3 


V6 





V5 


V5 


3 


V6 












f/3 



VS 
1 





1 

V6 
V6 





The columns of U-i form an orthonormal eigenbasis for the partial frame operator ^'3^' 3 with corresponding eigenval- 
ues {/l3;i, /l3;2, /l3;3) = {|, |, 0). For the n - 3 iteration, we pick = 1 and cancel the common terms in 



n 


3 


4 







2 
3 




4 

3 


5 
3 




5 

3 


5 

3 



to obtain J3 = {2, 3) and JTs 




|1, 3), implying 













1 







1 
















1 










1 




1 













1 






P2 = ^3.3 = 

P\ - ^3;2 = I 



72 = ^^43 



yi = /i4;l = 3- 

In Step B.3, we then compute the /?3 x 1 =2x1 vectors V3 and W3 in a manner analogous to (32), (33), (34) and (35): 

V3 = 

Note that in Step B.4, the role of permutation matrix IlJ is that it maps the entries of V3 onto the J3 indices, meaning 
that V4 lies in the span of the corresponding eigenvectors {M3;m)„,ej3: 



1 

V6 




r VS] 

3 
2 


Vs 


, W3 = 






- 3 - 



V6 

1 

V6 





1 





1 
1 
1 



1 

1 
1 



1 ] 




r V5 


I 


VS 




VS 


VS 


V5 




1 


V5 


VS 




VS 


VS 
























r 1 
6 






I 




Vs 







VS 




6 


1 




Vs 




Vs 




L VsJ 




L VS 



In a similar fashion, the purpose of the permutation matrices in Step B.5 is to embed the entries of the 2x2 matrix 
Wi into the J3 = {2, 3) rows and J'^ - {1,3) columns of a 3 x 3 matrix: 



Wi 
1 



^5 
vs 

1 

vs 



vs 

J_ 

vs 





1 

" vs 

VI 

vs 



__!_ 

" vs 

VI 

vs 





1 
1 
1 





VI 

vs 

1 

vs 



1 

1 
1 







VI _J_ 

vs vs 

_L VI 

vs vs 

1 



1 
1 
1 



__!_ 

" vs 

VI 

vs 



Vs 


Vs 


1 


6 


VS 


6 


S 


1 


Vs 


6 


vs 


6 


1 





Vs 


VS 


VS 
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For the last iteration « = 4, we again choose V4 = 1 in Step B.l. For Step B.2, note that since 



we have 1 4 - {3) and J'4 - {I}, implying 











1 




1 










1 













1 










1 













1 



Working through Steps B.3, B.4 and B.5 yields the UNTF: 



2 
3 

VI 

3 



_ j_ 

VI 

V6 



0^^ 



6 


6 


V5 


V5 


6 


6 


V5 


V5 


V6 


V6 



Us = 



I 


V5 


6 


6 


V5 


5 


6 


6 


V5 


1 


V6 


V6 



VI 

vs 

1 

V6 



(36) 



We emphasize that the UNTF F given in (36) was based on the particular choice of eigensteps given in (29), which 
arose by choosing ix,y) = (0, |) in (27). Choosing other pairs {x,y) from the parameter set depicted in Figure 1(b) 
yields other UNTFs. Indeed, since the eigensteps of a given F are equal to those of UF for any unitary operator U, we 
have in fact that each distinct ix,y) yields a UNTF which is not unitarily equivalent to any of the others. For example, 
by following the algorithm of Theorem 7 and choosing C/j = 1 and V„ - lin each iteration, we obtain the following 
four additional UNTFs, each corresponding to a distinct corner point of the parameter set: 



for(x,3;) = (i,i). 



F = 



F = 



1 


2 
3 





1 

3 


1 
3 





V5 

3 





V5 
3 


V5 
3 








1 


1 

V3 


I 

V3 


1 


1 

3 


1 

3 


1 

3 


I 

V3 





Vs 

3 


1 

3V2 


1 

3V2 


V2 
V3 








V5 
V6 


V5 
V6 





1 








1 

V3 


I 

V3 





1 


2 
3 


1 

3 


1 

3 








V5 
3 


V5 
3 


Vs 

3 


1 




1 

3 
V8 
3 


1 

V2 
V3 


1 

3 

1 

3V2 


1 
3 

1_ 

3 V2 











V5 
V6 


V5 
V6 



for(x,y) = (|,|). 



for(^,y) = (i,l). 



for(x,y) = (0,|). 



Notice that, of the four UNTFs above, the second and fourth are actually the same up to a permutation of the frame 
elements. This is an artifact of our method of construction, namely, that our choices for eigensteps, Ui, and {V„}'^~^ 
determine the sequence of frame elements. As such, we can recover all permutations of a given frame by modifying 
these choices. 

We emphasize that these four UNTFs along with that of (36) are but five examples from the continuum of all 
such frames. Indeed, keeping x and y as variables in (27) and applying the algorithm of Theorem 7 — again choosing 
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/2 = 



/3 = 



/5 = 



1 






















l-y 1 

















V(3.v- 


l)(2+3A-3y)(2-.v->-) 










^JyOy- 


1)(2+3a-33.)(2-a->') 




6 


^j(l-y){2-y) 






V5a(4-3a) 






3 V>'(2-3') 
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12y(2~3A)(l->.)(2-j) 
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-y'(2-3A).y(2-v) 



V(5-3T)(4-3.t-3j)(T-A-) 
V(5 -3y)(2-)-)(4-3A^3)-)t)-A) 



V(4-3a)(5-3j)(>'-a)(2+3a"^ 
12-y'(2-3A)(l-Y) 
y(4-3A)(2-).)(5-3>.)b-A-)(2+3A-3r) 
12a/(M4XW0 
y5(4-3A)(y-A)(2-A-T) 
2y3(2-3A)>(2->) 

y(4-3A)(5-3.v)(y-x)(2+3A-3)') 
12y(2-3A)(l-y) 
y(4-3A)(2-j)(5-3y)b-A)(2+3A-3).) 
12y(2-3AWl-}') 
y5(4-3A)0-A)(2-A-.y) 
2y3(2-3A).y(2-y) 



VA(3>-l)(>-A)(2+3A-3y) 

4-y'3(2-3A)(l-y) 
y.i3.(33.-l)Cy-A)(2+3A-3y) 
4y3(2-3A)(l-y)(2-),) 



yA(3y- 1 )(y-A)(2+3A-3y) 

4y3(2-3A)(l-y) 
yA><3j-l)ty-A)(2+3A~3).) 
4y3(2-3A)(l-3.)(2-j) 



Va-(5-3>-)(2-a->-)(4-3a-3V) 
4y3(2-3A)(l-y) 
yA(2-)-)(5-3j.)(2-A-y)(4-3A-^ 
4y3(2-3A)Xl-3') 



yA(5-3j)(2-A-y)(4-3A-3y) 
4y3(2-3A-)(l-y) 
yA(2-y)(5-3>-)(2-A-).)(4-3A-3;;0 
4y3(2-3AWl-3') 



Table 1: A continuum of UNTFs. To be precise, for each choice of (x,y) that lies in the interior of the parameter set depicted in Figure 1(b), these 
five elements form a UNTF for , meaning that its 3 X 5 synthesis matrix F has both unit norm columns and orthogonal rows of constant squared 
norm |. These frames were produced by applying the algorithm of Theorem 7 to the sequence of eigensteps given in (27), choosing Ui = I and 
V„ = I for all n. These formulas give an explicit parametrization for a 2-dimensional manifold that lies within the set of all 3 X 5 UNTFs. By 
Theorem 7, every such UNTF arises in this manner, with the understanding that (x, y) may indeed be chosen from the boundary of the parameter 
set and that the initial eigenbasis U i and the block-diagonal unitary matrices V„ are not necessarily the identity. 



Ui - I and V„ = I in each iteration for the sake of simpHcity — yields the frame elements given in Table 1. Here, 
we restrict ix,y) so as to not lie on the boundary of the parameter set of Figure 1(b). This restriction simplifies the 
analysis, as it prevents all unnecessary repetitions of values in neighboring columns in (27). Table 1 gives an explicit 
parametrization for a two-dimensional manifold that lies within the set of all UNTFs consisting of five elements in 
three-dimensional space. By Theorem 7, this can be generalized so as to yield all such frames, provided we both (i) 
further consider (x, y) that lie on each of the five line segments that constitute the boundary of the parameter set and 
(ii) throughout generalize V„ to an arbitrary block-diagonal unitary matrix, where the sizes of the blocks are chosen 
in accordance with Step B.l. 

Having discussed the utility of Theorem 7, we turn to its proof 

Proof of Theorem 7. (<=) Let {/Iml^^i {/"n)^=i ^e arbitrary nonnegative nonincreasing sequences and take an ar- 
bitrary sequence of eigensteps {{/l«;m)^^i)^^,) in accordance with Definition 1. Note here we do not assume that such 
a sequence of eigensteps actually exists for this particular choice of and {/i„)^^j; if one does not, then this 

direction of the result is vacuously true. 

We claim that any F = {./nlj^^i constructed according to Step B has the property that for all n = 1, . . . , A^, the 
spectrum of the frame operator F^F* of F„ = {/„')JJ,^[ is {A„-m}^^i, and that the columns of U„ form an orthonormal 
eigenbasis for F„F*. Note that by Lemma 3, proving this claim will yield our stated result that the spectrum of FF* 
is {/lm)m=i ^^'^ ^^'^^ = /^n for all n - I, . . . ,N. Since Step B is an iterative algorithm, we prove this claim by 
induction on n. To be precise. Step B begins by letting Ui = {Mi;m)^^i and f - yffi\Ui-\. The columns of U\ form an 
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01 
02 
03 
04 
05 
06 
07 
08 
09 
10 
11 
12 
13 




for m = M, . . . , 1 




;') where m' - max{m" e J', 



n 




else 



j-(m-l) ._ j-im) 



rrim-V) ._ Mni) 



end if 



end for 




Table 2: An explicit algorithm for computing the index sets J„ and J",, in Step B.2 of Theorem 7 



orthonormal eigenbasis for F ^ F* since Ui is unitary by assumption and 



//iMi;i m — I, 
m 1, 



for all = 1, . . . , M. As such, the spectrum of F^F* consists of /ui and M - I repetitions of 0. To see that this spec- 
trum matches the values of {/li;m)^^p note that by Definition 1, we know {/li;m)^^j interlaces on the trivial sequence 
{'^0;m)m=i = {0)^=1 ™ ^he sense of (3), implying /ii.,„ - for all m > 2; this in hand, note this definition further gives 
that Ai-i - Yjm=i -^Um - A*!- Thus, our claim indeed holds for n = 1. 

We now proceed by induction, assuming that for any given n = 1 , . . . , - 1 the process of Step B has produced 
Fn = {fn'}",,^i such that the spectrum of F^F^ is {/l„;m),')f^i and that the columns of U„ form an orthonormal eigenbasis 
for F^F*. In particular, we have F^F*U„ - U^D^^ where D„ is the diagonal matrix whose diagonal entries are 
{/!„;„, Defining D„+\ analogously from {A„+i-„,]'^^y, we show that constructing /„+i and t/„+i according to Step B 
implies F ^^^F*^^^U - U^^^D^^^^ where U„+] is unitary; doing such proves our claim. 

To do so, pick any unitary matrix V„ according to Step B.l. To be precise, let K„ denote the number of distinct 
values in {A„.^„,}^^^, and for any k = 1, . . . ,K„, let L„.i. denote the multiplicity of the A:th value. We write the index m 
as an increasing function of k and I, that is, we write {/l„;,„)^^i as {/l;,;m(i,/))f^i ^'f where mikj) < m{k',l') \f k < k' 
or if = k' and I < 1' . We let V„ be an M x M block-diagonal unitary matrix consisting of K diagonal blocks, 
where for any k - \,. . . ,K, the A:th block is an L,,;^ x L„-^k unitary matrix. In the extreme case where all the values of 
{'tn;m)^=i are distinct, we have that V„ is a diagonal unitary matrix, meaning it is a diagonal matrix whose diagonal 
entries are unimodular Even in this case, there is some freedom in how to choose V„\ this is the only freedom that the 
Step B process provides when determining In any case, the crucial fact about V„ is that its blocks match those 
corresponding to distinct multiples of the identity that appear along the diagonal of D„, implying DnVn - V„D„. 

Having chosen V„, we proceed to Step B.2. Here, we produce subsets I„ and STn of {1, ... , M) that are the remnants 
of the indices of {/l„;,„)^^[ and {/In+i respectively, obtained by canceling the values that are common to both 
sequences, working backwards from index M to index 1. An explicit algorithm for doing so is given in Table 2. Note 
that for each m - M, . . . , 1 (Line 03), we either remove a single element from both jj,'"* and J^"'^ (Lines 04-06) or 
remove nothing from both (Lines 07-09), meaning that I„ :- jj,'^ and J'„ :- J''^P have the same cardinality, which 
we denote R„. Moreover, since {/ln+i;m),^=i interlaces on {/l„;m)^^p then for any real scalar A whose multiplicity as a 
value of {/l„;m)^=i is L, we have that its multiplicity as a value of {/l«+i;m}m=i is either L- 1, L or L-H 1. When these two 
multiplicities are equal, this algorithm completely removes the corresponding indices from both I„ and J'„. On the 
other hand, if the new multiplicity is L - 1 or L -i- 1, then the least such index in I„ or J'„ is left behind, respectively, 
leading to the definitions of I„ or J'„ given in Step B.2. Having these sets, it is trivial to find the corresponding 
permutations ttj^^ and nj^^ on {1, ... , M] and to construct the associated projection matrices Ilj^^ and Ilj;^. 
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We now proceed to Step B.3. For the sake of notational simplicity, let {y6,)^"| and {yrlfl^i denote the values of 
Un;n,]mei„ and {/l„+i;,„}mej„, respectively. That is, lety8;rj„(m) = ^n;m for all m e I„ and y^j^(m) = ■^n+i-m for all m e J„. 
Note that due to the way in which I„ and jr« were defined, we have that the values of {/Srlfli (T'lfl^i 
distinct, both within each sequence and across the two sequences. Moreover, since {/l„;,„)mej„ and {A„+\-^„i]mej„ are 
nonincreasing while 7rj„ and nj^ are increasing on I„ and ^„ respectively, then the values [PAI'Li and are 
strictly decreasing. We further claim that {y, )f" i interlaces on {/J^lf" j . To see this, consider the four polynomials: 

M M R„ R„ 

Pn(x) = - /l„;m), /'n+Kjc) = Y\^^ ~ '^"+1;'")' ^^-^^ ^ {"[(-^ " /^r), c(-X) = - y,.). (37) 

m=l m— 1 r=l /■=! 

Since {j6r)f"i and {yj-lf"; were obtained by canceUng the common terms from {A„-i„}^^^ and {/l„+i;,n)^^[, we have that 
Pn+iix)/pn(x) = c{x)/b(x) foT all A: i {/ln;m)^=i- Writing any r = 1, . . . ,R„ as r = 7rj^,(m) for some m e J„, we have 
that since {/l«;m),')f=i C {/In+i applying the "only if direction of Lemma 5 with "pix)" and "^(x)" being /?„(jt:) 
and p„+iix) gives 

lim (x - ySr) ^ = lim (x - < 0. (38) 

Since (38) holds for all r = 1, . . . , applying "if direction of Lemma 5 with "p(x)" and "^(x)" being b(x) and c(x) 
gives that [yA^l^ indeed interlaces on {y6,.)^"j. 

Taken together, the facts that {y6, )f"[ and are distinct, strictly decreasing and interlacing sequences implies 

that the R„x \ vectors v„ and w„ are well-defined. To be precise. Step B.3 may be rewritten as finding v„(r), w„(r') > 
for all r, r' = 1 . . . , 7?„ such that 



Y\^>-yr") \\{yr'-lir") 

[vn{r)Y = - '-^ , [w„(r')]2 = . (39) 

\\iJ3r-l3r") Y[(yr'-yr") 

r" = l ;•" = ! 

Note the fact that the and y/s are distinct implies that the denominators in (39) are nonzero, and moreover that 
the quotients themselves are nonzero. In fact, since {J3r}\ is strictly decreasing, then for any fixed r, the values 
\Pr - /3r"}r"i=r Can be decomposed into r - I negative values {y6r - /3r"V.7,i, and R„ - r positive values [fir — Pf] , i • 
Moreover, since {y6,-)^"j C {yA^li, then for any such r, the values {J3r - yr"],",^i can be broken into r negative values 
{ySr - yr"Yr"^\ and R„ - r positive values {fir - With the inclusion of an additional negative sign, we see that 

the quantity defining [v„(r)]^ in (39) is indeed positive. Meanwhile, the quantity defining [w„(r')]^ has exactly r' - 1 
negative values in both the numerator and denominator, namely {jr' - A'')I''=\ and {y,/ - yr"V,'.,z}i, respectively. 

Having shown that the v„ and w„ of Step B.3 are well-defined, we now take /„+i and U„+i as defined in Steps B.4 
and B.5. Recall that what remains to be shown in this direction of the proof is that U„+i is a unitary matrix and that 
Fn+\ = {fn']"^\ satisfies F ^,F*^,U ^, - U To do so, consider the definition of U„+\ and recall that U„ is 

unitary by the inductive hypothesis, V„ is unitary by construction, and that the permutation matrices IIj^ and Ilj,^ 
are orthogonal, that is, unitary and real. As such, to show that Un+\ is unitary, it suffices to show that the R„ x R„ 
real matrix W„ is orthogonal. To do this, recall that eigenvectors corresponding to distinct eigenvalues of self-adjoint 
operators are necessarily orthogonal. As such, to show that W„ is orthogonal, it suffices to show that the columns of 
W„ are eigenvectors of a real symmetric operator. To this end, we claim 

(D„;j„ + vy„)W„ = W„D„+i;j„, WjW„(r, r) = 1, Vr = 1, . . .,R„, (40) 

where £>„;/„ and £>,,+! are the R„ x R„ diagonal matrices whose rth diagonal entries are given by fi^ - /l„.^-i(^) and 
yr - (r), respectively. To prove (40), note that for any r, r' = 1, . . . ,R„, 

R,, 

[(D„;j„ + v„yI)W„](r, /) = (D,,j„W„)(r, r') + (v„vlW„)(r, r') = /3,W„(r, /) + y„(r) J v„(r")W„ir", r'). (41) 

r"=l 
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Rewriting the definition of W„ from Step B.5 in terms of {/Sr)f"i and {yr}%i gives 

. v„(r)w„(r') 
WnC*", ) = — ■ (42) 

Substituting (42) into (41) gives 

Vn{r)w„{r') , , „^ v„(r")w„(r') 



[(A,;J„ + v„vJ)lV„](r, r') = /j. + v„(r) J] v„(r") 



= v„(r)w„(r ) — + > — . (43) 



Simplifying (43) requires a polynomial identity. Note that the difiference n,'"=i('*^~Tr") - Wr "'=\^^~Pr") of two monic 
polynomials is itself a polynomial of degree at most ^„ - 1, and as such it can be written as the Lagrange interpolating 
polynomial determined by the /?„ distinct points {Pr]^^^ 



,— 1 ^-1 v"' ^i^-" ,"-1 1 — r r=l 



(44) 



r"=\ r" = \ r" = \ r=\ r=\ ^' /■" = ! l~r , „ „ , r=l 



r=l 



Recalling the expression for [v„(r)]^ given in (39), (44) can be rewritten as 

R„ R„ R„ R„ 

Y\(x-Pr")-l]i^-rr') = J][v„(r")fY]ix-p,). (45) 



Dividing both sides of (45) by |~~[(jc -jS^") gives 



r"~l r" — l r" = \ r=\ 

ri^r" 

R„ 



r" = l 



For any r' = 1, . . . ,R„, letting x - j^' in (46) makes the left-hand product vanish, yielding the identity: 



(46) 



Substituting (47) into (43) and then recalling (42) gives 

[(Dn;i„ + v„vJ,)W„](r, r') = v„(r)w„(r') (— ^ + l) = Tr' ^ = 7r'W„(r, r') = (W„D„+i;^„)(r, /)• (48) 

\y,'-Pr I 1,'-Pr 

As (48) holds for all r, r' - 1, ...,/?„ we have the first half of our claim (40). In particular, we know that the columns of 
Wn are eigenvectors of the real symmetric operator Z);,;j„ + v„vj[ which correspond to the distinct eigenvalues {yrlf^j- 
As such, the columns of W„ are orthogonal. To show that W„ is an orthogonal matrix, we must further show that the 
columns of W„ have unit norm, namely the second half of (40). To prove this, at any x i {PA^^'^i we differentiate both 
sides of (46) with respect to x to obtain 



R,, R, 



Mm: 
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For any r' - I, . . . ,R„, letting x - in (49) makes the left-hand summands where r" + r' vanish; by (39), the 
remaining summand where r" - r' can be written as: 



1 



/•=i 



[w„(r')]2 ^ 



rl 



dr' - Jr) 



Jr' -Pr- 



v„{r")Y 



(50) 



r=l 



We now use this identity to show that the columns of W„ have unit norm; for any r' - I, . . . ,R,„ (42) and (50) give 



(W„ W„)(r , r ) = l,[W„(r , r )] = 2_j\^——— J = [w„(r )] _ ^^.^^ = [w„(r )] j 



1 



[w„(r')]2 



= 1. 



Having shown that W„ is orthogonal, we have that U„+i is unitary. 

Fortius direction of the proof, aU that remains to be shown is that ^„+i^,*+it/„+i = ^n-n^n+i- do this, we write 



■^n+r «+l 



F„F* + f .,f*,, and recall the definition of U„+] : 



W„ 
I 



n 



F„F:u„v„nl 



W„ 
I 



nj..+f„,j:,,u„v„nl 



Wn 

I 



n 



(51) 



To simplify the first term in (51), recall that the inductive hypothesis gives F^F*^U,^ - U^D^^ and that V„ was con- 
structed to satisfy £>„V„ - V„D„, implying 



F F*U V nl 



W„ 
I 



w„ 
I 



n^„ = f/„y„nj (n, D„nT ) 





I 



n 



(52) 



To continue simplifying (52), note that Ilj Z)„nJ is itself a diagonal matrix: for any m, m' - 1, . . . , M, the definition 
of the permutation matrix IIj^^ given in Step B.2 gives 



That is, Tlj D^Tlj is the diagonal matrix whose first R„ diagonal entries {fir}/^^ = i^n-.n-' (r)} ,Zi i^^tch those of the 
aforementioned R„ x R„ diagonal matrix Z)„;j„ and whose remaining M - R„ diagonal entries {/l„vr-i(m))m=ij +1 form 
the diagonal of an (M - R„) x (M - R„) diagonal matrix £>„;j=: 



DnJ„ 





Substituting (53) into (52) gives 



F„F:u„v„nl 



Wn 

I 



n 



Dnj,. 

D„,n 



W„ 
I 



Dn-iW„ 

Z)„;jc 



n 



Meanwhile, to simplify the second term in (51), we recall the definition of /„+i from Step B.4: 



fn+lfn+l ^n^n^I,, 



W„ 
I 



nj„ = u„v„nl 



i^l 0] 



w„ 
I 



nj„ = u„v„nl 



V v'^W 




n 



(53) 



(54) 



(55) 



Substituting (54) and (55) into (51), simplifying the result, and recalling (40) gives 



(D.^ +v„vi)W„ 
D„,n 



nj„ = u„v„ni 



D,rn 



n 
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By introducing an extra permutation matrix and its inverse and recalling the definition of U„+i, this simplifies to 



W„ 
I 



D,rn, 



Dn+\\X, 









n 



(56) 



We now partition the of D„+i into jr« and JT,^ and mimic the derivation of (53), writing D„+i in terms of 

D„+i;j,, and D„+i-jc. Note here that by the manner in which I„ and J'„ were constructed, the values of {/l„;,„)meJS are 
equal to those of {/i„+i;m)j,^, as the two sets represent exactly those values which are common to both {/i„;m)^^i and 
{^n+i;m}^j^i- As thcsc two sequcuccs are also both in nonincreasing order, we have £)„;/;; - Dn+\ jf^ and so 



D„+i.,jc 



Dn+lS„ 

A,;j;; 



(57) 



Substituting (57) into (56) yields F^^^F'^^^ ^n+\ ~ ^n+\^n+v completing this direction of the proof. 

(=>) Let {/Iml^^j and {/^nl^^i be any nonnegative nonincreasing sequences, and let F - {/„)^^[ be any sequence of 
vectors whose frame operator FF* has {/Iml^^i ^'■^ spectrum and has ||/„|p - //„ for all « = 1, . . . , A^. We will show 
that this F can be constructed by following Step A and Step B of this result. To see this, for any n - 1, ... ,A^, let 
Fn - {/«')"'=! and let {/i„;m)^^j be the spectrum of the corresponding frame operator F^F^. Letting Aq-^„, :- for all 
m, the proof of Theorem 2 demonstrated that the sequence of spectra {{/l„;,„),']f^[)jy^,) necessarily forms a sequence of 
eigensteps as specified by Definition 1 . This particular set of eigensteps is the one we choose in Step A. 

All that remains to be shown is that we can produce our specific F by using Step B. Here, we must carefully 
exploit our freedom to pick U\ and the y„'s; the proper choice of these unitary matrices will result in F, while other 
choices will produce other sequences of vectors that are only related to F through a potentially complicated series of 
rotations. Indeed, note that since {{/l„;m}^=i}^=o ^ valid sequence of eigensteps, then the other direction of this proof, 
as given earlier, implies that any choice of U\ and y„'s will result in a sequence of vectors whose eigensteps match 
those of F. Moreover, quantities that we considered in the other direction of the proof that only depended on the 
choice of eigensteps, such as I„, J'„, {y6, )^^j, [jA^li, etc., are thus also weU-defined in this direction; in the following 
arguments, we recall several such quantities and make further use of their previously-derived properties. 

To be precise, let Ui be any one of the infinite number of unitary matrices whose first column mi-i satisfies 
fi - yfjI\U\-^\. We now proceed by induction, assuming that for any given n - 1, ... - 1, we have followed 
Step B and have made appropriate choices for {y„')JJrJj so as to correctly produce F„ - {/„')|J,^j; we show how the 
appropriate choice of V,, will correctly produce /„+i. To do so, we again write the nth spectrum {/l„ m)*^_i in terms of 

K L ' wi 1 

its multiplicities as {A„-m(k,i)} i^li ■ For any k - 1, . . . , K„, Step B of Theorem 2 gives that the norm of the projection 



of /„+i onto the kth eigenspace of f „F* is necessarily given by 



ll-fn;'l»;m(l:,l)/n+ll 



lim (x - /l„;m(i,i)) 



Pn+\(x) 

p„(x) 



(58) 



where p„(x) and p„+i(x) are defined by (37). Note that by picking / - 1, A„-„(k,i) represents the first appearance of 
that particular value in {A„-^,„}^^^-^. As such, these indices are the only ones that are eligible to be members of the set 
I„ found in Step B.2. That is, I„ c {m(k, 1) : = 1, . . . , K„}. However, these two sets of indices are not necessarily 
equal, since only contains m's of the form m(k, 1) that satisfy the additional property that the multiplicity of An-m 
as a value in {/!„;,«' exceeds its multiplicity as a value in {/in+i;m)^^i- To be precise, for any given k = 1, . . . , K„, if 
m(k, 1) e then /l„;m(/t,i) appears as a root of p„+i(x) at least as many times as it appears as a root of Pn(x), meaning 
in this case that the limit in (58) is necessarily zero. If, on the other hand, m{k, 1) e I„, then writing ni^^{m{k, 1)) as 
some re {1, . . and recalHng the definitions of b{x) and c(,x) in (37) and v(r) in (39), we can rewrite (58) as 



\\P,rfiJn^x\\^ = - lim(.^ - A-)^^^ = - lim(x -/?,)^ 

X^Pr P„{X) X^Pr b(X) 



l](Pr-7r") 

r" = l 
R 



[Vn(r)f 



(59) 



r"=l 
r"+r 
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As such, we can write /„+i as 



(60) 



where each 



!■ (jTi (m)) '^^^ ^i*- norm by (59). We now pick a new orthonormal eigenbasis U„ := {u„;m]^=i 
for that has the property that for any k - 1, . . . , K„, both {Mn;m(i:,;) l^'i' and {M„;m(i,/))^'j span the same eigenspace 
and, for every m{k, 1) e J„, has the additional property that M„;„,(tj) = , j„ (L(it. i ») ^" ;fej„ (-(*-. i » /»+ ' ■ ^^'^h, (60) 
becomes 



= ^ v'„(7rj„(m))M„.„ = f/„ ^ v„(7rj„(»j))5,„ = f/„ ^ v„(r)5^-i = f/„nj^^ ^ v„(r)(5, = U„n}^^ 



mel„ 



mel„ 







(61) 



Letting V„ be the unitary matrix y„ = U*U„, the eigenspace spanning condition gives that V„ is block-diagonal whose 
Ath diagonal block is of size L„-i: x L„;jt. Moreover, with this choice of V„, (61) becomes 



meaning that /„+i can indeed be constructed by following Step B. 



□ 
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Appendix A. Proof of Lemma 5 

(^) Let {ym]m=\ interlace on {j6m),^=p ™d let A - /3„, for some m - 1, . . . ,M. Letting Lp denote the multiplicity of A 
as a root of p(x), the fact that {j8m)^=i C {y/,,)^^! implies that the multiplicity Lg of /I as a root of q{x) is at least Lp-l. 
Moreover, if > - 1 then our claim holds at A since 

lim(jc-i)^ = <0. 

x->A p{x) 

Meanwhile, if Lg = Lp - 1, then choosing irip - minfm : /3m = A} gives 

A« > I < m < nip — 1, 

Pm - A, nip < m < nip + Lp-l, (A.l) 

jS,„ < A, nip + Lp < m < M. 

We now determine a similar set of relations between A and all choices of y„,. For 1 < m < nip-1, interlacing and (A. 1) 
imply jm ^ /3m > 'i- If instead nip + 1 < m < nip + Lp - 1, then interlacing and (A.l) imply A - p„, < y,n < /?,„-! - 
and so jm - A. Another possibility is to have nip + Lp + I < in < M, in which case interlacing and (A.l) imply 
y,,, < /?„,-! < A. Taken together, we have 

7m > A, 1 < m < t7ip — 1, 

7m — ^, nip + 1 < ni < nip + Lp — 1, (A. 2) 

7m < A, nip + Lp + I < in < M. 

Note that the table (A. 2) is unlike (A.l) in that in (A. 2), the relationship between 7,,, and A is still undecided for 
m - nip and in - nip + Lp. Indeed, in general we only know y,„^ > /i,„p - ^, and so either j,„^ - A ox y,„^ > A. 
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Similarly, we only know jmp+L,, < f^m„+L„-i = so either r„,„+L„ = or rm„+L„ < ^- Of these four possibihties, 
three lead to either having Lq - Lp + \ ox Lq - Lj,; only the case where -y,,,^ > A and jm^+L < A leads to our current 
assumption that Lq - Lp — \ . As such, under this assumption (A. 2) becomes 

Jm > \ < m < nip, 

jm — A, nip + 1 < m < nip + Lp — \ , (A.3) 
y„, < A, nip + Lp < m < M. 

We now prove our claim using (A.l) and (A.3): 

in,, M m,, M 

C](x) in=l m-nip+Lp m-l m-mp+Lj, 

l\m(x - A) - hm = < 0. 

x->A p(x) x->A M '",,-1 M 

(x - A)"-" Yl (x - A„) Yl (x-/5„) Yl^A- n " ^"'^ 

m=l m=mp+Lp m-l m=mp+Lp 

We prove by induction on M. For M - 1, we have p{x) - x- /3i and q{x) - x-y\, and so if 
0> lim(x-/?i)44 = lim(x-Ai) ^''~^'^ = lim (x - y,) = ,61 - y, , 

x^fix p{x) .v^/3i (x-/3i) x^/Si 

then j6i < yi, and so {71) interlaces on {J3i}, as claimed. Now assume this direction of the proof holds for M' = 
1, . . . , M - 1, and let {jS»i),'Jf^i and {7m}^=i real, nonincreasing and have the property that 

lim (x - A«)— < Vm = 1, . . . , M, (A.4) 

A-^A, p(x) 

where p{x) and q{x) are defined as in the statement of the result. We will show that {jm]'^^y interlaces on 

To do this, we consider two cases. The first case is when and {ym]'^,^y have no common members, that is, 

Pm + Jtri for all m, m' - 1, . . . , M. In this case, note that if = fi,n' for some m + m' then the corresponding limit 
in (A.4) would diverge, contradicting our implicit assumption that these limits exist and are nonpositive. As such, in 
this case the values of {yS,,,)^^) are necessarily distinct, at which point (A.4) for a given m becomes: 

M M 

m'-\ m' = \ 

M ~ m-I M 



n ^ 1- r n \ 1 f Tm') m' = l m' = l ^. r-s 

> lim (X - B,„) = = . (A.5) 



m' = I 



m'=l m'=l m'-m+l 

m' tm 



Moreover, since /3,„ + y,,,' for all m, m', then the limit in (A.5) is nonzero. As the sign of the denominator on the 
right-hand side of (A.5) is (-1)"' the sign of the corresponding numerator is 

(- 1)" = sgn( Yl 06m - y,n')j = sgn(q(J3„,)) Vm = 1 , . . . , M. 

m' = l 

Thus, for any m - 2, . . . , M, q(x) changes sign over [/3m,/Sm-i], implying by the Intermediate Value Theorem that at 
least one of the roots {ym)m=i of q(x) lies in (J3m,/3m-i)- Moreover, since q{x) is monic, we have limi^M q(x) - oo; 
coupled with the fact that q(J3i) < 0, this implies that at least one root of q(x) lies in (ySj, oo). Thus, each of the M 
disjoint subintervals of (y6i, oo) u [U^^^2(/6m,y6m-i)] contains at least one of the M roots of qix). This is only possible if 
each of these subintervals contains exactly one of these roots. Moreover, since {ym),^^j is nonincreasing, this implies 
J01 < yi and /5„ < y,„ < /?,„_! for all m = 2, . . . , M, meaning that {ym),'Jf^[ indeed interlaces on {j6m),^=i- 

We are thus left to consider the remaining case where {ySm)^^j and {ym]^,^i share at least one common member. Fix 
A such that j3„, - A = y,„> for at least one pair m,m' = 1 , . . . , M. Let nip = min{m : /3m = A} and niq - min{m : y,„ = A]. 
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Let P(x) and Q(x) be (M - l)-degree polynomials such that p(x) — (x - A)P(x) and q(x) — (x - A)Q(x). Here, our 
assumption (A.4) implies 



q(x) (x - A)Q(x) Q(x) 

0> lim(x-y3J^ = \im(x-(3S- = Hm -^,„)|i^ Vm= 1,...,M. (A.6) 

j;^A» p{x) x^p,,, [x - a)P{x) x^p„, P{x) 

Since P{x) and Q{x) satisfy (A.6) and have degree M - 1, our inductive hypothesis gives that the roots {y,„)m^,„,of 
Qix) interlace on the roots {/3m}„,^m^^ of Pix). 

We claim that nig is necessarily either nip or nip + 1, that is, nip < niq < nip + 1. We first show that nip < nig, a fact 
which trivially holds for nip = 1. For nip > 1, the fact that {fim},,,^,,,^ C {ym]mi^m,i implies that the value of the {nip - l)th 
member of {jm]n#m, is at least that of the (m^ - l)th member of {y6,„)m#mp- That is, the {nup - l)th member of \y,n\m+m,, 
is at least ySfflp-i > X, meaning rUp-X < nig - 1 and so nip < nig, as claimed. We similarly prove that nig < + 1, a fact 
which trivially holds for nip = M. For nip < M, interlacing implies that the m^jth member of ),„^,„^, is at least the 
(nip + l)th member of {y/,, );«#/«,■ That is, the (nip + l)th member of {ym]mi^m^ is at most Pm^+i ^ A and so nip + l > nig, 
as claimed. 

Now, in the case that niq - nip, the fact that {(im]mi^mi, C {y;«)m#m, implies that 

j6m < tm < ■ ■ ■ < A»„+i ^ y,n,+i ^ ^ rm,-i < ■ ■ ■ < /3i < ri • (A.7) 

Since in this case y,„p+i = 7™,,+! < < the terms yS„,^^ = /I and y,„^ - y,„^^ - A can be inserted into (A.7): 

Pm <yM <■■■ < Pm,+\ < ym„+i < A< A< y6„,^_i < < ■ ■ ■ < j6i < yi, 

and so {yS,,,)^^, C {rm)m=i- In the remaining case where nig ^ nip + 1, having {y8,n)m^m„ C {y„,]mi.,t,„ means that 

/Sm <yM < ■ ■ ■ < Pm„+2 < ym„+2 < fim„+\ < ym„ < Pm.-l < Tm,,-! <' ■■</?!< Tl • (A.8) 

Since in this case y6,„^,+i < /I < ym,-i = y,,,,,, the terms y/Hp+i = y,„, = /t and yS,,,^ - A can be inserted into (A. 8): 

Pm <yM <■■■ < y6m„+2 < rm,,+2 < < /I < /I < r»V < Pm^-\ < ym„-l < ' ' ' < >6l < Tl 

and so {y8,„)^^j C {rm)m=i in this case as well. 



Appendix B. Proof of Lemma 6 

Fix any m- I,. . . ,M, and let L be the multiplicity of j3m as a root of p(x). Since 

lim (x - A„)4^ = hm (x - AJ-^ , (B.l) 

x^l3,„ p(x) x^0,„ p(x) 

where each of these two limits is assumed to exist, then the multiplicities of y6,„ as a roots of q(x) and r(x) are both at 
least L - 1. As such, evaluating Zth derivatives at /3,„ gives q^'^(/3„) - = f'^'-'(Pm) for all Z = 0, . . . , L - 2. Meanwhile, 
for I - L - I, I'Hopital's Rule gives 

1- r-«^^-r g(x) (x-ygj^ _ g<^-'>(;6„,) L\ _ Lq^^-'^(J5J 

x^y ^•''\(x) .™,(x-^„,)^-i p(x) (L-iy. p(^xp„,) p(^^(j5„) ■ ^""-^^ 

Deriving a similar expression for r(x) and substituting both it and (B.2) into (B.l) yields q^^^^^({im) - r'^^^^Xjim)- As 
such, q^'HPm) - r^^Xfim) for all / = 0, . . . , L - 1. As this argument holds at every distinct /?,„, we see that q(x) - r(x) has 
M roots, counting multiplicity. But since q(x) and r(x) are both monic, q(x) — r(x) has degree at most M - 1 and so 
q(x) - r(x) = 0, as claimed. 
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